Tagged “llm evaluation”
Research
What LLM Tests on SEC Filings Should Tell Financial Teams
A 13-model test on 45,964 10-Q filings finds fundamental-rank context improves return ranking, while direct EPS forecasts don't consistently beat analysts.
Research
Self-Debiasing LLM Judges: A Promising Result, Not a Reliability Proof
A new paper reports self-debiasing helped LLM judges in 20 of 21 model-bias combinations. Here is what that supports, what it leaves open, and how to test it on your own tasks.
Governance
Latent Harm Monitors Need a Matched-False-Alarm Test
A latent monitor caught 44% of harmful prompts versus 32% for refusals, but the authors say the gain follows the refusal decision. Here is what to test before trusting it.